The phrase "dinner dress" refers to the clothing you wear for a formal evening meal or dinner. It implies dressing up in more elegant attire than you would typically wear during the day.